Serial No.: 10/696,977 
Docket No.: 062020-1570 



AMENDMENTS TO THE SPECIFICATION 
[0015] FIGs. 10A-GG are a sequence of diagrams showing the ROI process of FIG. 9 as 
applied to an example matrix E. 

[0021] The software in memory 103 may include one or more separate programs, each of 
which comprises an ordered listing of executable instructions for implementing logical functions. 
In the example of FIG. 1, the software in the memory 103 includes one or more components of 
the method for recognizing road signs in a digital image 106, and a suitable operating system 
107. The operating system 107 essentially controls the execution of other computer programs, 
such as the method for recognizing road signs in a digital image 1064O&, and provides 
scheduling, input-output control, file and data management, memory management, and 
communication control and related services. 

[0022] The method for recognizing road signs in a digital image 106400 is a source 
program, executable program (object code), script, or any other entity comprising a set of 
instructions to be performed. When a source program, then the program needs to be translated 
via a compiler, assembler, interpreter, or the like, which may or may not be included within 
memory 103, so as to operate properly in connection with the operating system 107. 
[0025] When the computer 101 is in operation, the processor 102 is configured to execute 
software stored within the memory 103, to communicate data to and from the memory 103, and 
to generally control operations of the computer 101 pursuant to the software. The method for 
recognizing road signs in a digital image 1064 40 and the operating system 107, in whole or in 
part, but typically the latter, are read by the processor 102, perhaps buffered within the 
processor 102, and then executed. 

[0026] When the method for recognizing road signs in a digital image 1064 44 is 
implemented in software, as is shown in FIG. 1, it should be noted that the method for 
recognizing road signs in a digital image 1064 42- can be stored on any computer readable 
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medium for use by or in connection with any computer related system or method. In the context 
of this document, a "computer-readable medium" can be any means that can store, 
communicate, propagate, or transport the program for use by or in connection with the 
instruction execution system, system, or device. The computer-readable medium can be, for 
example but not limited to, an electronic, magnetic, optical, ele ctromagn e t i c, i nfrar e d, or 
semiconductor system, system, device, or propagation medium. A nonexhaustive example set 
of the computer-readable medium would include the following: an electrical connection having 
one or more wires, a portable computer diskette, a random access memory (RAM), a read-only 
memory (ROM), an erasable programmable read-only memory (EPROM, EEPROM, or Flash 
memory), and a portable compact disc read-only memory (CDROM). Note that the computer- 
readable medium could even be paper or another suitable medium upon which the program is 
printed, as the program can be electronically captured, via for instance optical scanning of the 
paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner 
if necessary, and then stored in a computer memory. 

[0027] In an alternative embodiment, where the method for recognizing road signs in a 
digital image 106443 is implemented in hardware, the method for recognizing road signs in a 
digital image 106444 can be implemented with any or a combination of the following 
technologies, which are each well known in the art: a discrete logic circuit(s) having logic gates 
for implementing logic functions upon data signals, an application specific integrated circuit(s) 
(ASIC) having appropriate combinatorial logic gates, a programmable gate array(s) (PGA), a 
programmable gate array(s) (FPGA), efc. 

[0042] In step 309, a determination is made whether all elements in R, G, and B have been 
processed. If No, then processing continues at step 310, where the indices ij are incremented 
to advance to the next element in R, G and 6. Processing then continues for this next element 
at step 303. If Yes, then processing stops at step 31 13 0O. At this point, binary segmentation 
matrices E1 and E2 contain 1's at locations that match the color criterion, and 0's at locations 
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that do not match. These segmentation matrices are used as input to the ROI extraction 
process (step 203 from FIG. 2). 

[0050] V* (503) then contains one element for each column, with each element having only 
one of two values: t if the column is valid; or /if the column is invalid. From V*, the left 
boundary x 0 1 (504) and right boundary x 0 2 (505) of submatrix S-\ are extracted, so that S A .- J =S^o\ 

[0056] Processing continues at step 6056 04, where vector C is resampled and then 
normalized to the same size as the column vector C temp i ate of template matrix T. The result is 
vector C norm . 

[0058] Column processing is now complete. At step 608604, the process waits until the row 
processing (done by the path starting at step 604605) is finished. Row processing is similar to 
column processing. In step 6086 07, a vector R is created by summing all elements of S along 
rows. Thus, R is a vector with one element for each row in 5", and the value of that element is 
the sum of all elements in that row. The formula for computing vectors is: 



[0059] Processing continues at step 60960S, where vector R is resampled and normalized 
to the same size as the row vector R temp i ate of template matrix T. The result is vector R norm . Next, 
at step 61060©, R norm (rows of the ROI matrix) is correlated with R temp i a te (rows of the template 
matrix). The result is correlation coefficient r R , which is computed using the following formula: 



[0060] The two paths (row and column) merge at step 607604. Step 607604 continues 
processing when correlation coefficients for row (r R ) and column (r R ) have been computed. At 
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step 607604, the row and column coefficients are compared to coefficient threshold values. In 
this example embodiment, r R is compared to a row threshold (0.5), r c is compared to a column 
threshold (0.5), and the sum of r R and r c is compared to a 2-D threshold (1 .2). If all three 
conditions are met, then a stop sign has been recognized in ROI S, and processing stops at step 
612640. If any condition fails, then no stop sign has been recognized in ROI S, and processing 
stops at step 611. 

[0068] After the correlation coefficient r is computed, processing continues at step 707, 
where the coefficient r is compared to a coefficient threshold value. If the coefficient is above 
the threshold, then a stop sign has been recognized in ROI S, and processing stops at step 
7097Q&. If any condition fails, then no stop sign has been recognized in ROI S, and processing 
stops at step 70870O. 

[0095] Processing continues at step 1 103. At this step, an OCR (Optical Character 
Recognition) algorithm is used to recognize the digit represented by each ROI speed limit 
candidate. OCR algorithms are well known in the art of image processing. In this example 
embodiment, the algorithm used was developed by Kahan to identify printed characters of any 
font and size. 
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